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(54) A method and apparatus for increasing the displayed detail of a tree structure 



(57) A method and apparatus (Fig. 1 ) for increasing 
the displayed detail of a tree structure (Fig.2). The 
present invention is for use on a computer controlled dis- 
play system and provides for visualization of a tree struc- 
ture so that a greater amount of the detail of the tree 
structure may be displayed in a display area. In the 
present invention, a tree structure is laid out (502) on a 
plane, and the surface about which the tree surface is to 
be warped is determined (503). Then the tree structure 
is warped (504) about an arbitrary surface for display 
(505). Such an arbitrary surface would include a surface 
defined by a parabola, a hyperbola or by the intersection 
of two lines. As a result, an increased number of nodes 
in each level of the tree can be displayed. 
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Description 

The present invention relates generally to the field 
of information display, and in particular to the display of 
hierarchical information structures. 

It is well understood that information visualizations 
provide insights to the underlying data. For example, for 
any given set of information, new information regarding 
patterns or relationships can be obtained by looking at 
attributes of the information. It is often useful to view the 
attributes of the information in a hierarchical structure. 
However a difficulty lies in displaying large hierarchical 
structures in a limited display area. 

EP-A-435,601 discloses a technique for displaying 
and manipulating three-dimensional representations of 
a tree structure which have rotating substructures. 

U-A-4,752,889 describes a graphic display that 
shows links between chunks of knowledge. The user, 
with mouse clicks, can obtain a display of links from a 
displayed chunk of knowledge to other chunks of knowl- 
edge, which are added to the display. Screen scrolling 
mechanisms allow movement from one area of the over- 
all graph to another. 

EP-A-535,986 describes a method for centering a 
selected node of a node link structure along a centering 
line. The nodes are in rows, and each row extends 
across a centering line with links between nodes in ad- 
jacent rows. When a user requests a centering operation 
for an indicated node, a sequence of images is present- 
ed, each including a row that appears to be a continua- 
tion of the row with the indicated node and that includes 
a continued indicated node that appears to be a contin- 
uation of the indicated node. 

Furnas. G.W., "Generalized Fisheye Views," CHI '86 
Proceedings, ACM, April 1986, pp. 16-23, describes fish- 
eye views that provide a balance of local detail and global 
context. Section 1 discusses fisheye lenses that show 
places nearby in great detail while showing the whole 
world, showing remote regions in successively less de- 
tail; a caricature is the poster of the New Yorker's View 
of the United States." Section 3 describes a degree of 
interest (DO!) function that assigns to each point in a 
structure, a number telling how interested the user is in 
seeing that point, given the current task, A display can 
then be made by showing. the most interesting points, as 
indicated by the DOI function. The fisheye view can 
achieve, for example, a logarithmically compressed dis- 
play of a tree, as illustrated by Fig. 4 of Furnas for a tree 
structured text file. Section 4 also describes fisheye 
views for botanical taxonomies, legal codes, text out- 
lines, a decisions tree, a telephone area code directory, 
a corporate directory, and UNIX file hierarchy listings. 
Section 5 indicates that a display-relevant notion of a pri- 
ori importance can be defined for lists, trees, acylic di- 
rected graphs, general graphs, and Euclidean spaces, 
unlike the geographical example which inspired the met- 
aphor of the "New Yorker's View," the underlying struc- 
tures need not be spatial, nor need the output be graphic. 



Fig. 6 of Furnas shows a fisheye calendar. 

EP-A-447.095 discloses a processor which 
presents a sequence of images of a workspace that is 
stretched to enable the user to view a part of a workspace 
5 in greater detail. The workspace includes a middle sec- 
tion and two peripheral sections that meet the middle 
section on opposite edges. Each of the sections appears 
to be a rectangular two-dimensional surface and they are 
perceptible in three dimensions. When the user is view- 
ing the middle section as if it were parallel to the display 
screen surface, each peripheral section appears to ex- 
tend away from the user at an angle from the edge of the 
middle section so that the peripheral sections occupy rel- 
atively little of the screen. When the user requests 
stretching, the middle section is stretched and the pe- 
ripheral sections are compressed to accommodate the 
stretching. When the user requests destretching, the 
middle section is destretched and the peripheral sections 
are decompressed accordingly. 

A method and apparatus for increasing the dis- 
played detail of a tree structure is described. The present 
invention is for use on a computer controlled display sys- 
tem and provides for visualization of a tree structure so 
that a greater amount of the detail of the tree structure 
may be displayed in a display area. In the present inven- 
tion, a two-dimensional tree structure is warped about 
an arbitrary surface for display. Such an arbitrary surface 
would include a surface defined by a parabola, a hyper- 
bola or a surface defined by the intersection of two lines. 
As a result, an increased number of nodes in each level 
of the tree can be displayed. 

The present invention provides a computer control- 
led display system having a display, a processing 
means, internal memory, a cursor control device, a key- 
board and external memory, said computer controlled 
display system for controlling the display of a tree struc- 
ture on a viewing area of said display, said tree structure 
comprised of a plurality of nodes laid out on a planar sur- 
face wherein each of said plurality of nodes has a planar 
address, characterised by comprising warping means for 
warping said tree structure about a predetermined sur- 
face so that an increased number of nodes of said tree 
structure are visible in said viewing area of said display. 
The method of the present invention is comprised 
^5 generally of the steps of receiving the node-link informa- 
tion representing the tree structure; laying out the 
node-link information to create a tree structure in a 
two-dimensional plane; applying a warping function to 
the planar address of each node to create a display ad- 
so dress and displaying the nodes of the tree at it's display 
address. The applied warping function will correspond to 
the surface about which the tree structure is warped. 

The invention further provides a method for display- 
ing a node link structure on a display, according to claim 
S5 8 of the appended claims. 

Preferably said step (c) further comprises the step 
of adding an offset to a node based on the node's level 
in the node-link structure, wherein said node-link struc- 



15 



20 



25 



30 



35 



3 



EP 0 694 878 A2 



4 



ture is visually perceived as closer to a viewer. 

Figure 1 is a block diagram of computer controlled 
display system in a preferred embodiment of the present 
invention. 

Figure 2 illustrates a two dimensional tree structure 
as is known in the prior art. 

Figure 3 illustrates the tree structure of Figure 2 
warped about an arbitrary surface. 

Figure 4 Is an illustration of a data structure for a 
node as may be utilized in a preferred embodiment of 
the present invention. 

Figure 5 is a flowchart of the general steps per- 
formed when creating the visualization of a tree structure 
in a preferred embodiment of the present invention. 

Figure 6 is a flowchart of the steps for creating dis- 
play addresses for nodes of the tree structure, i.e. warp- 
ing the tree structure, as may be performed in a preferred 
embodiment of the present invention. 

Figure 7 illustrates the tree structure of Figure 2 
warped about a parabolic surface as created by a pre- 
ferred embodiment of the present invention. 

Figure 8 illustrates the tree structure of Figure 2 
warped about a hyperbolic surface as created by a pre- 
ferred embodiment of the present invention. 

Figure 9 illustrates the tree structure of Figure 2 
warped about a surface defined by two intersecting lines, 
as created by a preferred embodiment of the present in- 
vention. 

EP-A-535.986 discloses the display of a tree struc- 
ture in two dimensions and the centering of a selected 
node along a centerline, and the use of animation steps 
for scrolling of the tree for centering a node. 

A method and apparatus for visualization of a tree 
structure with an increased number of nodes in a display 
area is described. In the following description numerous 
specific details are set forth, such as data models for rep- 
resenting a tree structure, in order to provide a thorough 
understanding of the present invention. It would be ap- 
parent, however, to one skilled in the art to practice the 
invention without such specific details. In other instanc- 
es, specific implementation details such as the system 
calls for causing a tree structure to be displayed on a 
screen, have not been shown in detail in order not to un- 
necessarily obscure the present invention. 

Hierarchically related information is often represent- 
ed as a tree. As used herein, the term node will refer to 
a point on the tree structure. Each node includes pointers 
to a parent node and one or more child nodes to create 
the tree structure. A root node is the highest level node. 
Leaf nodes are the bottom level nodes. 

When a tree structure becomes large. It may be dif- 
ficult or even impossible to present the entire tree on a 
display area in full detail. Thus, it is desirable to place as 
much of the tree structure into a display area as possible. 

It should be noted that a tree is in the general class 
of node-link structures. As will become apparent in the 
description below, the present invention could be imple- 
mented so as to support other node link structures. 



Overview of the Computer Controlled Display System 

Referring to Figure 1, the computer based system 
on which a preferred embodiment of the present Inven- 

5 tion may be Implemented is comprised of a plurality of 
components coupled via a bus 101. The bus 101 may 
consist of a plurality of parallel buses (e.g. address, data 
and status buses) as well as a hierarchy of buses (e.g. 
a processors^bus, a local bus and an I/O bus). In any 

TO event, the computer system is further comprised of a 
processor 102 for executing Instructions provided via 
bus 101 from Internal memory 103 (note that the Internal 
memory 103 is typically a combination of Random Ac- 
cess and Read Only Memories). The processor 102 will 

'5 be used to perform various operations in support of cre- 
ating the tree visualizations. Instructions for performing 
such operations are retrieved from Internal memory 103. 
Such operations that would be performed by the proces- 
sor 102 are described with reference to Figures 5-6. The 

20 processor 1 02 and Internal memory 1 03 may be discrete 
components or a single integrated device such as an Ap- 
plication Specification Integrated Circuit (ASIC) chip. 

Also coupled to the bus 101 are a keyboard 104 for 
entering alphanumeric input, external storage 105 for 

25 storing data, a cursor control device 1 06 for manipulating 
a cursor, and a display 107 for displaying visual output. 
The keyboard 1 04 would typically be a standard QWER- 
TY keyboard but may also be telephone like keypad. The 
external storage 105 may be fixed or removable mag- 

30 netic or optical disk drive. The cursor control device 1 06, 
e.g. a mouse or trackball, will typically have a button or 
switch associated with it to which the performance of cer- 
tain functions can be programmed. 

The currently preferred embodiment of the present 

35 invention has been implemented on a Silicon Graphics 
workstation with graphics facilities as described in SGI 
Graphics Library Programming Guide . Silicon Graph- 
ics, Inc. of Mountain View, California. The Silicon Graph- 
ics workstation provides for manipulating graphical ob- 

40 jects in a three dimensional space. However, it would 
have been apparent to one of skill in the art to implement 
the present invention on other suitable computer sys- 
tems providing graphical functionality which manipulate 
graphical objects in a two dimensional space. 

45 

Overview of the Tree Visualization 

Figure 2 illustrates a visualization of tree structure . 
laid out on a plane as is known in the prior art. A tree 

50 structure comprised of levels 201, 202 and 203 is dis- 
played in display area 200. Each of the levels 201-203 
of the tree structure are aligned in a column. Level 201 
is comprised of a single node (node 223) and level 202 
is comprised of three nodes (nodes 220-221 . ) Level 203 

55 contains sixteen nodes (nodes 204-219). The nodes in 
level 203exceed the entire height x 224 of display area 
202. So for example, the nodes 204, 205 and 219 would 
not be completely displayed. Thus it is readily observed 
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that the height x 224 of display area 202 accommodates 
a maximum number of complete nodes (here 13). As is 
known in the art. nodes which are above or below the 
display area may be scrolled in. 

Figure 3 illustrates the tree structure of Figure 2 
warped about an arbitrary surface for display. As will be 
described below, the arbitrary surface provides a frame 
of reference for transforming a node's planar address to 
a "warped" display address. Referring to Figure 3, it is 
readily observed that all sixteen nodes at level 3 (nodes 
204'-219') are displayed at level 203'. Clearly it would 
have been possible to display more than sixteen nodes. 
This is contrasted with the 13 nodes from level 203 of 
Figure 2. Thus, given the same dimensions for a display 
area, more information is available using the warping of 
. the present invention. It should further be noted that the 
nodes 220'-222' of level 202' are also displayed in a more 
compact manner. Further examples of warping to other 
surfaces are provided below in Figures 7-9. 

Internal Representation of Node - 

As noted above, a tree is an instantiation of a 
node-link structure. Figure 4 illustrates a minimal data 
structure for a node in a tree structure in a preferred em- 
. bodiment of the present invention. Other structures may 
be utilized which contain more or less information. Re- 
ferring to Figure 4, the structure is comprised of a plural- 
ity of pointers 401 -402, node information and a layout 
address for the node 404. The pointer 401 points to a 
parent node and the pointers 402 point to one or more 
child nodes. The pointers 401 and 402 are typical for a 
tree structure representation. The node information 403 
may contain a label for the node to be used when it is 
displayed, or it may contain a pointer to such information. 
The layout address 404 contains the address for the 
node with respect to the plane as generated in the layout 
plane step described in Figure 5. As will be described in 
greater detail below, the layout address 404 would sub- 
sequently contain the display address after the node is 
"warped." 

■ -"'i ■ 

Creating the Tree Visualization 

The basic steps for creating the tree structure are 
described with references to the flowcharts of Figures 5 
and 6. Referring to Figure 5, a tree structure is received, 
step 501 and laid out onto a plane, step 502. Creation of 
a tree structure is beyond the scope of the present in- 
vention and various techniques for creating tree struc- 
tures are known in the art. Moreover, the creation of tree 
structures often depends on the nature of the tree struc- 
ture being created. Similarly various techniques for lay- 
ing out a tree structure on a plane are known in the art 
and could be used with the present inveintion. In a pre- 
ferred embodiment of the present invention, a layout 
technique described in EP-A-535.986 is utilized. 

Inherent in the underlying operation of the present 



invention is a step by which the surface to the tree struc- 
ture is warped is determined, step 503. Preferably, this 
is done through a user specifying the desired shape via 
a menu. Alternatively, the surface could be automatically 

s selected by the computer controlled display system ac- 
cording to some predetermined criteria relating to the 
size and shape of the tree structure. In any event, al- 
though exact timing is not critical, it must be done before 
the tree struGture.,is warped. 

10 Once the tree structure is laid out on a plane each 
node wilt have associated with it a plane address. This 
plane address may directly correspond to a screen ad- 
dress for display as illustrated by the prior art, or it may 
require some scaling in order for it to be displayed. In 

IS any event, the plane address is then warped with respect 
to the specified predetermined surface, step 504. This 
warping is conceptually analogous to bending the struc- 
ture about the surface and creates a three-dimensional 
visual effect for the displayed portions of the tree struc- 

20 ture. The result of this warping step is to provide new 
display addresses for each node of the tree structure. 
The warping step is described in greater detail with re- 
spect to Figure 6. The tree structure is then displayed at 
the display address, step 505. In this display step, the 

25 tree structure is rendered by the computer controlled dis- 
plays systems so that the nodes are displayed at their 
display address. 

In a preferred embodiment the techniques for scroll- 
ing described in EP-A-535,986 are utilised, although it 

30 will be appreciated that other techniques may be used. 
Referring now to Figure 6, the "warping" step is de- 
scribed in greater detail. It should first be noted that the 
coordinate references described below are in units of 
inches. Referring to Figure 6, a planar address for a node 

35 is received, step 601 . Warping is effected with respect to 
a particular surface shape. In a preferred embodiment 
the shapes includes a parabola, hyperbola and an inter- 
section of two lines. Each of the various shapes are de- 
fined by a particular function which is described in great- 

40 er detail below. The received planar address is then ad- 
justed according to the function corresponding to the 
shape the tree is being warped about, step 602. In the 
currently preferred embodiment, the X coordinate ad- 
dress corresponds to a column or level at which the par- 

45 ticular node is at and will not change. Y and Z coordinates 
are determined using the function corresponding to the 
desired surface. Next, as an optional step, an offset may 
be added to the derived Y and Z addresses to control the 
"closeness" at which the tree structure appears to the 

so viewer, step 603. The offset applied depends on the par- 
ticular level at which the node is at. The effect of drawing 
the structure closer to the viewer, as expected, causes 
the tree and corresponding text to be larger It has been 
determined experimentally that an offset equation of N x 

ss 5 inches (N x 125mm), where N is the level of the tree 
structure for the node, produces acceptable results. 

Note that it would also be possible to implement the 
present invention so that the "warping" shape is different 
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for each level of a tree structure or that warping only oc- 
curs at certain levels (e.g. when the number of nodes in 
a level exceeds a certain threshold.) 

Warping Surfaces 

As noted above, various warping surfaces nnay be 
utilized in a preferred embodiment of the present inven- 
tion. Two-dimensional shape formulas for various warp- 
ing surface types can be found in various references^ e.g. 
"MATHEMATICAL TABLES FROM HANDBOOK OF 
CHEMISTRY AND PHYSICS ELEVENTH EDITION", 
Copyright 1959 by THE CHEMICAL RUBBER PUB- 
LISHING COMPANY Cleveland, Ohio. Each of the 
shape formulas includes constants which define the ac- 
tual end shape. Through experimentation, values for the 
constants have been determined which provide accept- 
able results. Generally, the horizontal coordinate for a 
node will remain fixed white the shape formula is used 
to find vertical and depth coordinates. 

Figure 7 illustrates a two-dimensional tree structure 
warped about a parabola which extends back in the Z 
direction. Via the steps described in f^igures 5 and 6. 
each level of the tree structure is laid out along the pa- 
rabola in the Y and Z coordinates. The X coordinate Is 
unchanged from it's original planar address. The formula 
for deriving the Y and Z coordinates is Y**2 = 4fZ. where 
f is a constant which defines the distance from the focus 
to the vertex. In a preferred embodiment, it has been ex- 
perimentally determined that the constant f = 10 inches 
(25cm) provides acceptable results. 

Figure 8 illustrates a two-dimensional tree structure 
warped about a hyperbolic surface (actually half of a hy- 
perbola). Again, the X coordinate remains unchanged. 
The formula for deriving the Y and Z coordinates is 
Z**2/a**2-Y**2/b**2 = 1 where a and b are constants de- 
fining the semi-axes of the hyperbola. It has been deter- 
mined experimentally that that values a = 5 and b = 7 
provide acceptable results. It should be noted that this 
warping results in the bottom and top nodes being "clos- 
er" to the viewer and thus more readable. 

Figure 9 Illustrates a surface defined by the intersec- 
tion of two lines. Again, the X coordinate remains un- 
changed. The formula for deriving the Y and Z coordi- 
nates is he surface is defined by the equation z=-alYl, 
where a is a constant. This surface is particular advan- 
tageous because it is easy to compute. It has been de- 
termined experimentally that a = 1 .4 provides acceptable 
results. 



Claims 

1 , A computer controlled display system having a dis- 
play, a processing means, internal memory, a cursor 
control device, a keyboard and external memory, 
said computer controlled display system for control- 
ling the display of a tree structure on a viewing area 



of said display, said tree structure comprised of a 
plurality of nodes laid out on a planar surface 
wherein each of said plurality of nodes has a planar 
address, characterised by comprising warping 
5 means for warping said tree structure about a pre- 
determined surface so that an increased number of 
nodes of said tree structure are visible in said view- 
ing area of said display. 

10 2. A computer controlled display system for displaying 
visualizations of hierarchically related information, 
said hierarchically related information comprised of 
a node link structure, said computer controlled dis- 
play system comprising; 

15 a display for displaying said node-link struc- 

ture on a viewing area of said display; 

receiving means for receiving a node-link 
structure; 

layout means coupled to said receiving 
20 means, said layout means for creating planar 
addresses for each of said nodes in said node link 
structure; 

warping means coupled to said layout means, 
said warping means for warping said node-link 
25 structure about a surface; and 

rendering means coupled to said warping 
means and said display, said rendering means for 
causing said warped node-link structure to be dis- 
played in said viewing area of said display. 

30 

3. The system of Claim 1 or 2 wherein said warping 
means is further comprised of: 

means for receiving a planar address for a 
node of said structure; and 
35 means for adjusting said planar address for 

said node to create a display address for said node 
using a predetermined surface equation, said pre- 
determined surface equation corresporiding to said 
surface or predetermined surface. 

40 

4. The system of Claim 3 wherein said means for 
adjusting said planar address is further comprised 
of means for modifying said display address of said 
nodes of said tree structure so that said structure is 

45 perceived as closer to a viewer. 

5. The system of Claim 4 wherein said means for mod- 
ifying said display address is further comprised of 
(1 ) means for adding a first offset to nodes at a first 

50 level of said tree structure and a second offset to 
nodes at a second level of said tree, or (2) offset 
applying means for adding an offset to said display 
address based on the level of the node in the node 
link structure. 

55 

6. The system of any of the preceding claims wherein 
said predetermined surface is a parabola, a hyper- 
bola, or a surfaced defined by two intersecting lines. 
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the system preferably further comprising means for 
specifying the surface to which said structure is 
warped. 

7. The system of any of the preceding claims further s 
comprising means for scrolling said node-link struc- 
ture about said surface. 

8. A method for displaying a node link structure on a 
display, said method comprising the steps of: 

a) receiving a node-link structure, said node-link 
structure comprised of a plurality of nodes; 

b) laying out said node-link structure on a plane 
to create a planar address for each of said plu- 
rality of nodes; 

c) adjusting the planar address of each node of 
said node-link structure using a surface function 20 
to create a display address; and 

d) displaying said nodes of said node-link struc- 
ture at their corresponding display address. 

25 

9. The method of Claim 8 wherein step (c) further com- 
prises the step (c1 ) of creating a three-dimensional 
spatial coordinate from a planar address/ said step 
(c1) preferably further comprising of the step of 
retaining a horizontal coordinate for said node in 30 
said node-link structure and creating vertical and 
depth coordinates from said surface function. 

10. The method of Claim 8 or 9 wherein said surface 
function is an equation for a hyperbola, a parabola. ^5 
or a surface defined by two intersecting lines. 



40 



45 



50 



55 



EP 0 694 878 A2 



Processor 
102 



Internal 
Memory 
103 



I 



I 



BUS 101 



I 



Keyboard 
104 



External 
Storage 
105 



Cursor 
Control 
Device 
106 



Display 
107 



Fig. 1 



EP 0 694 878 A2 




Fig. 2 



EP 0 694 878 A2 



203" 




Fig. 3 



EP 0 694 878 A2 



Pointer To 
Parent Node 
401 


Pointers To 
Child Nodes 
402 


Node 
information 
403 


Layout 
Address 
404 



Fig. 4 







601 


Receive Planar Address 




For A Node Of The 




Tree Structure 






r 



Adjust Planar Address 
According To Function 
Associated With 
Warped to Surface 



602 





r 








603 


Add Offset to Each Node 




(OPTIONAL) 





Fig. 6 



EP 0 694 878 A2 



Receive A Tree Structure 
For Rendering 







SOI 



Lay out Tree Structure 
On A Plane 



502 



Determine Surface 
About Which Tree 
Structure Is Warped 



503 



Warp Tree Structure 
About Surface To 
Obtain "Warped" 
Screen Address 



504 



Display Tree Structure 
Using Warped 
Screen Addresses 



505 



Fig. 5 



EP 0 694 878 A2 




r 



EP 0 694 878 A2 




(19) 



JEuropaisc 
European 
Office our 



Europaisches Patentamt 
Patent Office 
uropeen des brevets 




(12) 



(88) Date of publication A3; 

10.07.1996 Bulletin 1996/28 

(43) Date of publication A2: 

31.01.1996 Bulletin 1996/05 

(21) Application number: 95305051.5 

(22) Date of filing: 20.07.1995 



(11) EP 0 694 878 A3 

EUROPEAN PATENT APPLICATION 

(51) lntCI.6: G06T 11/20 



(84) Designated Contracting States: 


(72) Inventor: Robertson, George G. 


DE FR GB 


Foster City, California 94404 (US) 


(30) Priority: 28.07.1994 US 282848 


(74) Representative: Reynolds, Julian David 


Rank Xerox Ltd 


(71) Applicant: XEROX CORPORATION 


Patent Department 


Rochester New York 14644 (US) 


Parkway 




Marlow Buckinghamshire SL7 1YL (GB) 



(54) A method and apparatus for increasing the displayed detail of a tree structure 



(57) A nnethod and apparatus (Fig. 1 ) for increasing 
the displayed detail of a tree structure (Fig. 2). The 
present invention is for use on a computer controlled dis- 
play system and provides for visualization of a tree 
structure so that a greater amount of the detail of the 
tree structure may be displayed in a display area. In the 
present invention, a tree structure is laid out (502) on a 
plane, and the surface about which the tree surface is 
to be warped is determined (503). Then the tree struc- 
ture is warped (504) about an arbitrary surface for dis- 
play (505). Such an arbitrary surface would include a 
surface defined by a parabola, a hyperbola or by the in- 
tersection of two lines. As a result, an increased number 
of nodes in each level of the tree can be displayed. 
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